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Abstract 

This paper examines issues in designing post-school follow-up studies in special education. The 
examination focuses on survey research techniques, which are widely used in the investigation of the 
post-school adjustment of former students with handicaps. The issues addressed are: (a) identifying 
needed information, (b) mode of data collection, (c) questionnaire construction (wording and format, 
pretesting, reliability and validity), (d) sample design, (e) contacting the sample, (f) response rates, (g) 
3urvey report, and (h) tracl<ing procedures. Sound procedures in designing and implementing follow- 
up systems for special education programs are discussed. 
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Issues and Guidelines In Designing Follow-up Systems 
for Special Education Service Programs 

Interest in the transition of students with disabilKies from public high school programs to the 
post-school environment has increased in the recent past. The importance of this Issue has grown 
during the past decade as a result of the increased numbers of youth and young adults in tl»o U.S. 
population, and the development of new school programs for students with handicaps. Particular 
attention has been given to the transition of students with moderate and severe handicaps, who typically 
were not served extensively in traditional public schools before the enactment of Public Law 94-142 in 
1975. 

In order to be effective, school programs and rehabilitation services for students with handicaps 
need to document the post-school outcomes for students who received special education services, and 
subsequently to use this infon lation to make programming and planning decisions to Improve transition 
services (Bruininks, Lewis, & Thurlow, 1988; Thurlow, Bmininks, & Lange. 1989). For example, data on 
students from different types of programs (e.g., integrated vs. segregated, vocational vs. academic) 
should be correlated with post-school outcomes (Edgar, 1988). Assessing the post-school status of 
former students in special education has several important implications: (1) influencing and changing 
public policies about programs and their populations (Schroedel, 1984); (2) identifying needed post- 
school services an i problems in coordinating assistance for former students and their families; (3) 
documenting continuing needs of former students for use in making decisions about reforms in school 
curricula and practices; and (4) evaluating the cost effectiveness of programs by conducting cost- 
benefit or cost-effectiveness analyses for the programs and society (Bruininks et al., 1988). These 
implications all move toward improvemfei.: and modification of special education programs, when 
appropriate. 

The goal of collecting information about former students in special education requires that follow- 
up studies be conducted of these students. Recently, several follow-up studies have investigated 
Information about outcomes for students with different handicaps who received services provided by 
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local public schools (Bruininks, Thurlow. Lewis, & Larson, 1988; Edgar, 1987; Fardig, Algozzine, 
Schwartz, Hensel, & Westling, 1985; Hasazi, Gordon, & Roe, 1985; Schaiock, Wolzen, Ross, Elliott, 
Werbel, & Peterson, 1986; Thurlow, Bruininks, & Lange, 1989; Thurlow, Bruininks, Wolman, & Steffens, 
1989; Wehman, Kregel & Seyfarth, 1985; Zigmond & Thornton, 1985). Most of this lnform.9tion is the 
result of efforts by special projects and university-based researchers, with special funding to support 
evaluation and follow-up components. It is important, however, that public school programs be able to 
independently document and evaluate in a systematic way the outcomes of their programs for students 
with disabilities. This goal can be attained by developing follow-up systems that can be used by school 
buildings and districts (Thurlow, Bruininks, & Lange, 1989). 

Follow-up studies on the post-school adjustment of former students with handicaps generally 
employ a survey research methodology, a form of data collection frequently used in the social sciences. 
In special education, survey research studies have been used ;o address many important questions. 
Such studies, for example, have been used to estimate the incidence and prevalence of handicapping 
conditions, measure attitudes toward practices such as malnstreaming, collect data on personnel training 
needs, develop information from key informants (parents, teachers, etc.) on service needs and policy 
issues, describe the number and characteristics of students in service programs, and assess the post- 
school adjustment of former students. Despite the widespread use of survey research methodology in 
special education and related service fields, there is limited attention to sound procedures in many 
studies, and little discussion of these issues in the research literature concerned with special education. 

This paper examines existing studies and discusses important issues in designing follow-up 
studies that employ survey research techniques. Also discussed are the implications of using sound 
procedures in designing and implementing follow-up systems for special education programs. 

Conducting Sun/ev Research in Special Educaticii 

Several steps must be followed in conducting survey research (Borg & Gall, 1983; Fowler, 1984). 
Presented in Figure 1 is a conceptual model of the several steps involved in conducting surx'ey research 
studies, with each step representing a number of decisions that may enhance Oi hamper the accuracy 
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of the findings (Fowier, 1984). in addKion to initiai decisions, the survey research process requires the 
appiication of a variety of standards to insure reilat>le and vaiid study findings. The decisions and the 
standards to be appiied in conducting a successfui foiiow-up survey of persons with handicaps are in 
most cases simiiar to those involved in a survey of persons without handicaps. Some aspects of this 
process, however, are peculiar to special education populations. 
Identifying Needed Information 

Follow-up studies of former students with handicaps typically intend to investigate the adjustment 
of these persons to society. This adjustment may tie reflected in several areas of lite, including 
interpersonal relationships, employment, financial status, community participation, and many other areas 
(Bruininks, McGrew, Thurlow, & Lewis, 1988). Information collected prior to questionnaire construction, 
through needs assessment research from key informants, may help to determine which aspects of post- 
school adjustment should be investigated. In fact, needs assessment research frequently uses survey 
research procedures. For example, survey research carried out by Lange, Thuriow, and Bruininks (1988) 
revealed that professionals who work with youth and adults with handicaps believe that employment and 
vocational success are the most important types of information needed for follow-up evaluations of 
secondary instructional programs and for evaluating the cost-effectiveness of these programs. In most 
of the follow-up studies of former students with handicaps, the predominant measure of adjustment has 
been employment outcomes (Edgar, 1987; Fardig et al., 1985; Hasazi et al., 1985; Mithaug, HoriuchI, 
& Fanning, 1985; Schalock, Wolzen, Ross, Elliott, Werbel, & Peterson, 1986; Semmel, Cosden, & 
Konopak, 1985; Wehman et al., 1985; Zigmond & Thornton, 1985). 

Since community adjustment is multifaceted, schools need to assess more than employment 
outcomes of former students (Bruininks & Thurlow, 1988; Edgar, 1988). Although the results of Lange, 
Thurlow, and Bruininks (1988) showed that professionals primarily are interested in the study of factors 
related to employment of youth with handicaps, other groups of persons (e.g., parents) may be 
interested in different aspects of post-school life for persons with handicaps, such as social networks 
and relationships, behavioral adjustment, or extent of community integration. Contrary to unidimensional 
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approaches to the adjustment of former students in special education, a multidimensional perspective 
of community adjustment and integration of youth with handicaps has been advocated recently by 
several researchers (Bruininks, McGrew et al., 1988; Halpern, Nave, Close, & Nelson, 1986). 

Two important strategies involving key informants can be used to define the information needed 
In follow-up studies. One approach involves the application of structured group process methods 
(Moore, 1987). These methods provide strategies for soliciting and evaluating opinions of key 
informants. Nominal group procedures are useful to assess the judgments of participants through 
methods that maximize the participation of group members and systematically pool these judgments 
through structured rating methods (Delbecq, Van de Ven, & Gustafson, 1975). 

The Delphi technique is another useful technique that can be used to identify areas of post- 
school adjustment. In this technique, questionnaires are sent to persons who are knowledgeable about 
a particular subject (e.g., school principals, project leaders, counselors). The goal of this approach is 
to obtain a consensus among the persons questioned atu)ut the topic of interest. This is obtained by 
sending questionnaires several times to the respondents and by gradually modifying them according 
to the respondents' input (Borg & Gall, 1983; Delbecq et al., 1975). For example, in one study using 
the Delphi technique, participants rated the desirability and feasibility of possible future trends in 
community services for persons with disabilities (Putnam & Bruininks, 1986). In another study, a two- 
iteration Delphi technique was used (McKinsie Senter & Houston, 1981). First, four groups of 
participants (professionals and non-professionals) were asked to rate the desirability of position 
statements about the future of teacher education. Then, in the second round, participants were asked 
to reconsider their previous answers based on the responses of other respondents in their group. 

An additional approach in defining survey research questions involves a detailed analysis and 
synthesis of existing literature (Liglit & Pillemar, 1984) to Identify areas consistently used in previous 
studies. Table 1 presents such a synthesis of outcomes in previous post-school studies. Inspection 
of this table, and similar analyses, provides the researcher with valuable information on the data used 
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in past research efforts. More sopfiisticated analyses, sucfi as effect size and visual displays, could be 
used to assess tfie findings of previous studies (Light & Pillemar, 1984). 
Mode of Data Collectio n 

One of the most important decisions in designing a survey study is to choose the best method 
of data collection. Often, this decision will determine the rate of response of the subjects (Fowler, 1984). 
Three methods are widely used to collect information In sun/ey research: mail questionnaires, telephone 
interviews, anc^ face-to-face interviews. An additional altemative Is to use a combination of methods 
O=owler, 1984, van Houten & Hatry, 1987). Although each technique has certain advantages and 
disadvantages, the 'best' method will vary depending on the topic studied, the objectives of the sun/ey, 
the population being researched, and available resources (Dillman, 1978; Frey, 1983). 

Comparison ratings of these three methods have been reported on several performance 
characteristics. Some of the characteristics analyzed by Dillman (1978), and Frey (1983) show that: (a) 
the most expensive method is usually the face-to-face interview, (b) response rates from the general 
public decrease and item nonresponses generally increase by using mail questionnaires, (c) socially 
desirable responses are mor& likely to occur in face-to-face interviews, and (d) the likelihood of avoiding 
unknown bias from refusals will be higher in face-to-face and in telephone interviews than in mail 
surveys. 

One of the most important considerations in the selection of an appropriate method of data 
collection is the nature of the population to be studied (Dillman, 1978; Fowler, 1984; Frey, 198'3). This 
is especially true in surveys of persons with disabilities. In an integrative review of surveys of adults with 
deafness, Schroedel (1984) reported wide variability in mean response rates in studies that used either 
mail or face-to-face surveys. Response rates of persons with deafness on mail sur\ "^ys ranged from 
25.5% to 75.8%, with an average response rate across studies of 49.0%, while response rates in face- 
to-face interview studies ranged from 38.1% to 100%, with an average response rate of 76.6%. 

Is there an optimal survey method to be used wilh persons with handicaps? The answer to this 
question depends in part on who answers the survey - the person with handicaps, his/her parents, a 
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teacher, a caretaker, etc., and on the nature of the handicap. For example, a specific disadvantage of 
maii questionnaires is that persons with reading and writing difficulties are less likely to respond than 
they would be to a telephone survey or a face-to-face interview (Fowler, 1984; Sinclair & Johnson, 1989). 
On the other hand, persons with speech disabilities may be more reluctant to answer telephone 
interviews. The advantage of telephone and face-to-face interviews is that assistance can be provided 
to the respondent, which is beneficial to persons who need help completing the survey. In addition, 
many people with handicaps probably would want to talk with the interviewer for some time (Sinclair & 
Johnson, 1989). These concerns play a less important role when the respondents are individuals other 
than the persons with handicaps (e.g., parents, relatives, caretakers). 

When planning the survey, it is important to consider the appropriateness of the survey 
methodology in relationship to the characteristics of respondents. Sigelman, Schoenrock, Winer, 
Spankel, Hromas, Martin, Budd, and Bensberg, (198!) reported results of four methodological studies 
of interview strategies involving persons with mental retardation. The results identified serious problems 
of acquiescence (i.e., the tendency to respond affirmatively to yes-no questions regardless of content), 
position responses (e.g., selecting the last item in a series), and other difficulties in interviewing persons 
with mental retardation. However, response rates and response reliability were quite high with the use 
of appropriate survey techniques. This is just a single example that emphasizes the Importance of 
considering respondent characteristics in designing items and selecting procedures. Such 
considerations are equally important to consider when assessing parents, professionals and other 
respondent groups. 
Questionnaire Construction 

Principles guiding the construction of questionnaires for the general public should be rigorously 
applied when constructing questionnaires for persons with handicaps. Because of the special 
characteristics of the population with handicaps, additional considerations must be addressed. 

Questionnaire wording and format . The format and the questions should be easy to follow for 
the interviewer (in telephone and face-to-face interviews), the respondent, and the data processor (van 
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Houten & Hatry, 1987). Of special interest here are considerations related to obtaining reliable and 
valid answers from the respondent, both via the questionnaire format or an interviewer. 

Several guidelines and rules^ have been suggested for questionnaire construction. Some of 
these are designed to maximize reliability or to obtain a consistent measurement (Fowler, 1984), and 
others to increase the validity of tho results. For example, van Houten and Hatry (1987) have suggested 
keeping the wording simple, making questions clear, unambiguous and one-dimensional, avoiding 
skipping patterns of questions, asKing the least sensitive questions first, trying to minimize memory 
problems and mental and emotional effort, providing a consistent frame of reference, and avoiding 
questions about which the respondents may not be knowledgeable. Other suggestions include: (a) 
avoiding long questionnaires, long questions, psychologically-threatening questions, negative questions, 
and biased or leading questions, (b) making the questionnaire attractive, (c) providing brief and clear 
instructions, and (d) using examples {Borg & Gall, 1983). Worthen and Sanders (1987) list over 30 
questions derived from criteria in the areas of question sequence, question wording, establishing and 
keeping rapport and eliciting cooperation, instructions, and technical quality. 

These guidelines should be carefully followed when constructing questionnaires designed to 
survey the adjustment of persons with handicaps. Failing to do so may decrease the response rate, 
or the number of questions answered cn returned questionnaires, and may give invalid results if 
questions are misinterpreted or misunderstood. 

Several examples exist of the importance of these guidelines when sun/eying special 
populations. For instance, replies to questions by persons with handicaps (Sigelman et al., 1981; 
Wyngaarden, 1981), who may have d<fficulties understanding ambiguous terms or unclear questions, 
certainly will be influenced by the clearness and unambiguity of questions as well as the use of simple 
words. Questionnaires that are difficult to follow may increase the number of questions skipped and 
left unanswered. Constructing attractive questionnaires may encourage persons with handicaps to 
respond, as well as facilitate the answering process. Asking many questions that require recollection 
of past events may present a significant memory burder) to persons with mild and moderate learning 
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disabilities. Another consideration is that parents of persons with handicaps may be particularly 
sensitive to questions at>out the handicapping conditions of their children and may interpret questions 
that are inappropriately worded in a psychologically threatening manner. Sigelman and her colleagues 
(1981) found that yes-no and pictorial choice questions increased the responses of persons with mental 
retardation, but decreased the validity of the results. In addition, these researchers suggested that 
although the use of examples can increase the responsivenes^s of individuals with mental retardatioa 
these persons may have a tendency to give res$oonses that echo back the items used as examples. 
They suggest using either-or questions in surveying persons with mental retardation, because high 
responsiveness together with relatively high rciiiability and validity can be obtained using this category 
of questions. 

Pretesting the questionnaire . A questionnaire should be pretested before it is used in a study. 
Dillman (1978) suggests that questionnaires should be submitted to three groups of people for the 
pretest. The first group would include colleagues or trained professionals who understand the purpose 
of the study. The second group would consist of potential users of the data The third pretest includes 
subjects drawn from the population to be sun/eyed. This procedure was followed \n transition studies 
at the University of Minnesota (Bruininks & Thurlow, 1988; Sinclair & Johnson, 1989). In these studies 
of former students in special education, the follow-up interview was submitted to several groups for 
criticism of its content and readability. Some of these groups consisted of colleagues or trained 
professionals (university professors, research staff, and graduate students), and of potential users of the 
data (a task force of parents and care providers of adults with r^enta! retardation, and special 
educators). Based on the suggestions made by these groups of p ns, the interview was changec?, 
Folk)wing these changes, a pilot study was conducted with a small sample of the population to be 
studied, in order to determine the length of the interview in an actual interview situation, the readability 
and clarity of the questions, and to verify the clarity ind manageability of the procedures. 

Reliability and validity of the instrument . Reliability' is Ihe extent to which people in comparable 
situations will answer questions in similar ways' (Fowler, 1984, p. 84). Several of the rules already 
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mentioned for wording and formatting a questionnaire are designed to improve the reliability of an 
instrument. The use of unambiguous questions that can provide a consistent measure across subjects 
Is particularly relevant. 

Fowler (1984) defines validity as the extent to which the answer given is a true measure and 
means what the researcher wants it to mean or expects It to mean' (p. 84). This author describes three 
factors that may contn )ute to low validity in an instrument: (1) respondents' lack of knowledge, {2} 
memory decay on questions that require recall of the past, and (3) social desirability. Some of the ways 
to increase the validity of a questionnaire are avoiding questions about which the respondents may not 
be knowledgeable, trying to minimize questions that require memory of past events, using self- 
administered questions, and promising confidentiality and anonymity to respondents. A specific 
phenomenon that decreases the validity of the results is acquiescence, or the tendency to answer 
affirmatively to yes-no questions regardless of their content. Sigelman et ai. (1981) found that persons 
with lower IQ (e.g., persons with severe retardation) were more likely to respond affirmatively to yes- 
no questions than persons with higher IQs (e.g., persons with mild disabilities). 

Assessing reliability of instruments often is problematic in survey research studies. For example, 
in a national census study of private residential facilities (Bruininks, Hauber & Kudia, 1980), it was 
necessary to summarize the number of persons in facilities by level of mental retardation. To increase 
the reliability of this item, a special study was conducted of a simple procedure tor classifying persons 
by level of mental retardation. This simple procedure produced a correlation of .80 with standardized 
IQs, and solved a very troublesome source of error in the study procedures. 

Finally, an essential consideration in obtaining reliable and valid information is to insure 
adequate training of data collectors to obtain true responses, and establishment of their consistency in 
deriving comparable results from the same respondents (i.e., interrater agreement). When the 
population to be studied is composed of persons with moderate or severe disabilities, special strategies 
have to be developed in order to conduct the interviews and obtain valid results. For example, 
Wyngaarden (1981) used role-playing and simulation sessions to train interviewers to test persons with 
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mental retardation. Mathematica Policy Research (1982) has developed a useful videotape to train 
interviewers; it contains box\n information on interview techniques and samples of interviews. 
Sample Design 

In most cases, it is not necessary to collect survey Information from every member of the group 
of interest. This is more often the case when the group of interest has many members, such as all 
graduates of special education programs in a large urban school district over a five-year period. In 
cases where it has been decided that only a part of a group needs to be surveyed in order to obtain 
accurate and reliable information that represents the entire group, a sampling plan needs to be 
developed. The sample of potential respondents for a survey must be identified in a way that will insure 
comparability to the entire group. 

Worthen and Sanders (1987) define 'sample design' as the plan by which a sample is to be 
drawn, dis. guishing this term from 'sample selection,' the actual drawing and listing of sample 
members. Worthen and Sanders present three methods of sampling as the most common approaches 
in educational evaluation: (1) Haphazard - members drawn on the basis of accessibility, (2) Judgment - 
members drawn on the basis of expert judgment or best guesses about those who will best reflect the 
characteristics of the entire group, and (3) Probability - members drawn on the basis of the probability 
with which they occur in the entire group. 

Random sampling procedures, a subset cf probability sampling, are probably the best known 
and most frequently used with a fairly homogeneous population. In some situations, random sampling 
Is applied within certain pre-defined subgroups of the entire group. For example, if one were to want 
to draw a sample from all students with mild handicaps in a school district, one might first identify all 
students considered to have learning disabilities, all students considered to have emotional disabilities, 
all students considered to have speech/language disabilities, and all students considered to have mild 
mental retardation. If the four groups are approximately equal in number, a sampling plan would be 
to randomly select the same number from each group, if the four groups differ significantly In size, a 



14 



12 

sampling plan might involve first determining the percentage of the total group in each subgroup, then 
randomly selecting numbers that reflect the sample proportions of the desired sample size. 

Random sampling can be accomplished by using a random numbers table, putting all names 
In a hat, selecting every third name (or whatever interval Is needed to end up with the desired number), 
or by using a computer program. The kay to appropriate random sampling lies \n the initial 
Identification of the group of interest. The initial identification must be accurate. Thus, if the desire was 
to sample all students in special education who were in the class of 1988, it would be inappropriate to 
select from among those names of special education students on the graduation roster, for it is known 
that significant numbers of students in special education drop out of school without graduating (Wolman, 
Bruininks, & Thurlow, in press). 
Contacting the Sample 

« Initial contacts of the sample typically occur by mail, although this is not necessary. Generally, 
however, it is more feasible, particularly if a larger sample size has U^en selected. Even for mailed 
questionnaires, the use of pre-letters that indicate a questionnaire is coming has been found to increase 
response rates without significantly increasing costs (Cotton & Kane. 1989). It is importan: to determine 
the best source of initial conteict. In mail surveys, for example, an assessment of potential reactions of 
respondents should be considered. In some cases, a judgment might be made that the principal of 
the high school attended by former students would be best, while in others it might be decided that 
contact by a former teacher might be best. Other alternatives for school-based follow-ups include a 
superintendent or other higher level administrator or a representative of the graduating class (i.e., 
another former student). 

Plans also need to be made for a follow-up strategy. Additional letters, postcard reminders, and 
telephone calls are among the alternatives for follow-up to initial contacts. Anyone planning to conduct 
a follow-up study of former students in special education programs must be prepared for significant 
follow-up efforts (assuming that no ongoing tracking system is in place). In a recent mail follow-up 
study of over 1500 students, Bruininks, Thurlow, Lewis, and Larson (1968) obtained responses from 



15 



13 

71.0% of individuals who had been in a college track program in high school, 63.5% of individuals who 
had been in d vocational track program, and 66.0% of individuals who had been in special education. 
Initial responses rates for these groups after the first contact letter were approximately 40%, 30%, and 
20%. respectively. The first contact was a cover letter from school principals. After approximately three 
weeks, a reminder post card was sent to all nonrespondents. A second copy of the questionnaire and 
another letter were sent about six weeks after the initial contact. At this point, extra efforts were directed 
toward the special education group, which was of primary interest in the study. Approximately 12 weeks 
after initial contacts, a new letter from one of each of the schools' special education teachers was sent 
to these former students, along with a copy of the questionnaire. Next, telephone contacts were made 
to the students in the special education group (and, to a random sample of individuals in the vocational 
and college groups). At this point, teachers were employed to make some contacts, as were student 
networks (e.g., student still in school would contact student from an earlier class). Clearly, considerable 
effort had to be exerted. The amount of effort required is multiplied when certain types of former 
students are the target sample (e.g., individuals with emotional disabilities, dropouts). Successful efforts 
to obtain information from reluctant responders is considered necessary to accurate estimation of a 
population mean (Green, 1989). 

Initial contact via telephone is more feasible when the target sample size is not too large for the 
available personnel to handle. Telephoning requires a considerable time investment (which for some 
groups may not be any more than the time required for multiple attempts to contact by mail). Personal 
contacts also provide opportunities for clarification (e.g., about the purpose of the sun^ey), probing (e.g., 
how to get in contact with a former student who has moved), and effective contact (e.g., if target sample 
includes individuals with reading difficulties, a mailed contact may be ineffective). 
Response Rates 

In conducting survey research, a major cause of bias in the results is the failure to collect data 
from a sufficiently high proportion of the individuals selected for inclusion in the study (Dillman, 1978; 
Fowler, 1984; Williams & MacDonald, 1986). Response rates are calculated to reflect the extent to which 
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this bias may exist. The response rate statistic generally is calculated l)y dividing the number of people 
Interviewed or responding by the total number of people originally sampled. An alternative procedure 
is to consider In the original sample of potential respondents only those subjects who v/ere found and 
Vi^lth whom contact was made (Dillman, 1978). Based on these two approaches, it can be deduced that 
three groups ot subjects should be identified: the total number of subjects meeting the selection criteria, 
the total number of subjects found, and the total number of subjects who responded to the survey. In 
this way, both types of response rates can be reported: (1) the number of respondents out of the 
number of located potential subjects, and (2) the number of respondents out of the total number of 
potential subjects. 

The effect of nonresponse on survey estimates depends on the percentage of nonrespondents 
and the extent to which those nonrespondents are biased. Powler (1984) considers the standard for 
a minimum acceptable response rate to be around 75%. Borg and Gall (1983) propose that if more 
than 20% of the respondents are missing, it is very likely that the results of the study may be altered. 
Thus, it Is suggested that a portion of the nonresponding group be checked to determine whether they 
constitute a biased sampling. If a significant number of contacted persons decline to participate. It is 
important to know whether these persons differ from those who responded (Dillman, 1978). This 
information can be obtained by comparing a common set of data on the subjects who responded and 
subjects who did not respond. Bruininks and Thurlow (1988) suggest that for schools, a logical choice 
of data on which to make comparisons between respondents and nonrespondents is school record 
data, such as graduation rates, grade point averages, and absenteeism rates. For groups with more 
severe handicaps, the strategy may consider test scores at exit from school. If differences are found 
on these measures, however. It does not mflan that the study necessarily is invalid. An alternative 
possibility is to statistically correct for initial di-.-rences or at least to evaluate findings in relationship to 
initial sample characteristics. 

What is considered to be an acceptable response rate in samples of persons with handicaps? 
Schroedel (1984) reviewed several follow-up surveys of persons with different types of disabilities. These 
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studies t ua response rates ranging from 27% to over 70%. Bruininks and Thurlow (1988) suggested 
that a reasonable response rate in special education should be at least 50%. Table 1 Is a summary 
of several follow-up studies of persons with different degrees of handicaps. One of the variables 
summarized in this table is the response rate in each study (If reported, either explicitly or implicitly). 
As this table reveals, most reviewed studies did report response rates, with rates ranging from 57% to 
91%. 

Several factors may influence the response rates of the selected samples. These are: mode of 
data collection (Fowler, 1984), wording and fomiat of the questionnaire (Sorg & Gall, 1983; Fowler, 
1984), interest in the topic investigated (Dillman, 1978), follow-up or contact techniques such as 
telegrams, telephone calls, and certified mailings (Borg & Gall, 1983), and use of monetary payment or 
other incentives. 

Some variables that influence response rates are exclusive to samples of persons with 
handicapping conditions. One of the most important variables seems to be the nature and/or severity 
of the handicapping condition of the respondents. For example, in a recent study (Thurlow, Bruininks, 
& Lange, 1989), differences were found in response rates for individuals with moderate and severe 
mental retardation compared to those with mild retardation. Of an initial sample of fomier students with 
moderate and severe mental retardation, approximately 90 percent were found and over 90 percent 
agreed to participate (i.e., 80% of the initial sample). Of an initial sample of former students with mild 
degrees of retardation, 72 percent were found and of these 73 percent agreed to participate (i.e., about 
53% of the initial sample). A similar trend is seen in some of the studies reported in Table 1. In other 
words, several studies that followed former students with mild disabilities obtained lower response rates 
(e.g., 57%, 59%, 65.3%, 66%) than some investigations that surveyed persons with moderate, severe, 
and profound disabilities (e.g., 71%, 81%, 86%). However, an opposite picture is described by Sigelman 
et al. (1981), who found that for respondents with mental retardation, responsiveness was positively 
associated with IQ. In addition, it has been found that students wrth severe emotional disabilities had 
significantly lower response rates than students with mild emotional disabilities (Thurlow, Larson, & 
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Bruin^ks, 1989). Thus, the specific handicapping conditions may interact with the level of severity of 
the handicap in influencing response rates in surveys. Whether persons with mild degrees of disabilities 
are more 'defensive' (Williams & McDonald, 1986) than persons with more extensive degrees of 
handicaps is a question that should be investigated. Several aspects, such as having different reference 
or comparison groups (i.e., comparing themselves with persons without handicaps and not with persons 
with handicaps), having a less salient handicap, and being relatively better adjusted to society, may be 
some of the reasons for not wanting to recall an association with special education sen/ices. When 
comparing response rates of subjects with handicaps, it is Important to take into account who the 
respondents were in each study, and whether they were the persons with handicaps or other persons 
related to the subjects (e.g., parents, relatives). 

In the post-school follow-up of students in special education, anottier variable Influencing 
response rates is whether the sample is contacted after a few years or after many years since leaving 
school. As the years pass, records can be lost, persons may be more difficult to find (e.g., changing 
addresses, moving to other towns, deceased), and refusals to cooperate may increase. The most 
effective way to obtain high response rates for ex-students in special education is to have an 
established follow-up system, with adequate procedures for tracking students as they leave school 
(Bruininks & Thuriow, 1988). 
The Sun/ev Report 

Fowler (1984) describes two functions of a good methodological description: "To provide a good 
understanding of how well sample estimates are likely to describe the population from which the sample 
was drawn .... [and] to provide the procedural details needed to replicate a data collection effort 
and/or detect procedural differences between surveys that would affect comparability • (p. 141). 

Information reported by researchers about data collection procedures varies from study to study. 
In some cases information that might be the cause of sun/ey error (e.g., insufficient response rates, or 
lack of comparability between respondents and nonrespondents) is not provided to the readers. In 
addition to reporting a factual description of the data collection process (e.g., sampling procedures. 



17 

questionnaire design procedures, description of fieid procedures), Fowier (1984) suggests that other 
aspects of the survey study shouid be reported either in the study Itself or in an appendix. These 
aspects are the report of possible types of errors, numerical estimates of the amount of sun/ey error 
according to the particular sample design, inten/iewers' effects on the answers If a telephone inten/iew 
was carried out, effects of nonresponse on sample estimates and information about nonrespondents, 
and the reliability and validity of the instruments. 

Table 1 presents a summary of the types of information about survey procedures reported in 
a number of studies of former students with handicaps. As is evident in this table, certain types of 
information were provided by all or nearly all reports (e.g., response rate, description of subjects), while 
other types of information were provided by only a few (e.g., comparisons of respondents and 
nonrespondents). 

Developing A School-Based Follow-uo Svstem 

While most follow-up studies to date have been conducted by university people or by special 
evaluation projects, schools cannot rely on these avenues to obtain consistent follow-up information on 
former students in their programs. Increasingly, school systems will need to develop their own follow- 
up procedures to obtain good information on outcomes attained by their former students. This 
evaluation practice is important to insure that curricula remain germane to the post-school needs of 
students, that education personnel receive the information and training to increase their effectiveness, 
that information can be developed to increase retention of students, and that school systems can assess 
and improve necessary coordination with post-school sen/ices. 

The principles and guidelines discussed in the previous section should be interpreted not just 
as theoretical concerns in the post-school follow-up study of students with handicaps, but rather as 
having practical implications for building follow-up systems in schools. A project of the Minnesota 
Department of Education (MDE), Interagency Office of TransKlon Sen/ices, in collaboration with the 
Minnesota University Affiliated Program (MUAP) on Developmental Disabilities, has developed a post- 
school follow-up system to investigate statewide the experiences of former students in special education. 
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The goal of constructing such a system is that local schools and programs would use It Independently 
on an ongoing basis. The process of conducting a survey of the post-school status of students with 
handicaps Is explained ir. a manual designed for teachers and other school professionals (Sinclair & 
Johnson, 1989). The manual contains Information atx>ut sub-tasks that must be completed. For 
example, selection of the subject sample is comprised of the following sub-tasks: location of the list of 
all special education students that exited school in determined years, selection cf the subjects, 
assignment of Identification numbers, and the recording of the ID numbers. 

The basic steps In Figure 1 are applicable to conducting a post-school follow-up in a local 
school system. The steps described in Figure 1, and discussed in greater detail earlier, are relatively 
easy to follow once it has been decided that follow-up will occur and sufficient resources have been 
assigned to the task. What is lacking in these steps, however, is a key element in ensuring successful 
follow-up - the establishment of a tracking system. 

Tracking orocedures . Established and routine procedures are necessary for tracking students 
as they leave and after they have left school. In fact, most follow-up efforts are Impeded by the 
requirement that students have to be found after they have been out of the school system for some 
time. While schools generally have the last known family address for each student, this is not very 
helpful if there is considerable mobility in the target sample or the time interval is great between exit 
from school and follow-up. Although generally it is possible to locate students with moderate to severe 
disabilities by contacting local service agencies, this is not the ideal way to proceed. A planful 
approach to tracking former students Is much preferred, and probably necessary for students with milder 
disabilities who cannot be found through local service agencies. Thus, schools must maintain contact 
with their former students or the students' caregivers on a periodic basis. Yearly intervals are 
recommended so that advantage can be taken of post-office forwarding procedures. 

For those attempting to follow students for the first time, the recommendation for a systematic, 
already-established tracking system is not helpful. In nis case, it is necessary to pursue students in 
as many ways as possible, including mailings, contacting service agencies, and talking to students' 
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former teachers. It is often useful to attempt to make contacts through the student-friend networtc for 
students with milder handicaps. Students currently in school often know a student from one or two 
years back, and this student, in turn, may know other students. Several of the procedures to track 
former students in special education could be simplified if a prospective approach to following-up 
students would be applied. This approach should include implementation of systematic data collection 
procedures while students arc still in school (Edgar, 1988). 

An important advantage of this approach is that information needed to plan eciucational 
programs in future-referenced terms can be developed and used In developing educational plans and 
strategies for accessing and coordinating needed services as persons leave school programs. The U.S. 
Office of Special Education Programs has recognized the need for better in-school and post-school 
tracking systems by recently funding a number of research and development projects. One project is 
designing a simple baseline instrument for all youth with handicaps, and special modular assessment 
procedures for particular subgroups of students in special education programs (Johnson, Thurlow, 
Bruininks, Weatherman, & Sinclair, 1988). This effort also includes a post-school follow-up survey 
component based on a series of previous studies (Bruininks, Thurlow, Lewis, & Larson, 1988; Thurlow, 
Bruininks, & Lange, 1989; Thurlow, Bruininks, Wolman, & Steffens, 1989). 

Conclusion 

Survey research is an important and necessary strategy for studying questions and issues in 
special education. T he problems such procedures are designed to address are essential, but rarely 
simple, to study. In special education, survey research studies are used commonly to address many 
important questions. Such studies, for example, are used to estimate the incidence and prevalence of 
handicapping conditions, measure attitudes, collect data on personnel training needs, develop 
information from key informants (e.g., parents and teachers) on sen/ice and policy issues, describe the 
number and characteristics of students in service programs, assess the post-school adjustment of 
former students, and many other important issues, it is evident that survey research studies are 
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cmmonly used in special education and related fields, and it is equally evident that the process of 
research or the use of acceptable practices has been given limited attention in the published literature. 

A statement attributed to Sir Josiah Stamp, who wrote near the beginning of this century, 
defined rather perceptively some of the persistent dilemmas faced in conducting survey research studies 
on social issues. Stamp noted that: 

The government is very keen at amassing statistics, it likes to add them, subtract them, 
and raise them to the Nth power. But you must never forget that, in first instance, the 
information comes from the village watchman, who puts down what he pleases. 

Stamp's perceptive comment identifies several important and obvious aspects to conducting survey 

research: the process starts with a clear need, proceeds with the collection of information (generally 

numbers and judgments) from an identified sample of people, and concludes with the analysis and 

Interpretation of information. In our judgment, no behavioral and social research strategy is so widely 

used, so variably and inadequately applied, and so inconsistently reported as the process and conduct 

of survey research studies. These problems may be particularly acute in special education studies. 

By applying acceptable practices, the results we develop from survey research studies will be 

easier to interpret (i.e., possess internal validity) into an integrated knowledge base, be more easily 

assimilated into decisions that seek to improve practices, and be more readily generalized to other 

populations and settings (i.e., possess external validity) . The name of the game is to find the most 

appropriate village watchpersons, describe who they represent, and elicit information from them so that 

is accurate and useful. 



23 



21 

References 

Borg, W. R., & Gall, M. D. (1983). Educational research: An introduction . New York: Longman. 

Bruininks, R. H., Hauber, F. A., & Kudia, M. J. (1980). Nattonal survey of community residential facilities: 
A profile of facilities and residents in 1977. American Journal of Mental Deficiency . 84. 470- 
478. * -~ 

Bruininks, R. H., Lewis, D. R.. & Thurlow, M. L. (Eds.). (1988). Assessino outcome, costs, and banefits 
of special education programs (Project Report Humber 88-1). Minneapolis: University of 
Minnesota, University Affiliated Program. 

Bruininks, R. H., McGrew, K. S., Thurlow, M. L, & Lewis, D. R. (1988). Dimensions of community 
adiustment amono voun o aduits with Intellectijal disabilities . Paper presented at the Eighth 
World Congress of the Intemational Association for the Scientific Study of Mental Deficiency, 
Dublin, Ireland. 

Bruininks, R. H. & Thurlow, M. L. (1988). Evaluating post-school transition of secondary students with 
moderate to severe handicaps (Final Report). Minneapolis: University of Minnesota. University 
Affiliated Program. 

Bruininks, R. H., Thurlow, M. L, Lewis, D. R., & Larson, N. W. (1988). Post-school outcomes for 
students in special education and other students one to eight years after high school. In R. H. 
Bruininks, D. R. Lewis, & M. L Thuriow (Eds.), Assessino outcomes, costs, and benefits of 
special education programs (pp. 9-1 1 1). (Project Report Number 88-1). Minneapolis: University 
of Minnesota, University Affiliated Program. 

Colton, D. A., & Kane, M. T. (1989). The effect of ore-letters on sun/ev study response rates . Paper 
presented at the annua! meeting of the American Educational Research Association, San 
Francisco. 

Oelbecq, A L., Van de Ven. A., & Gustafson. D. (1975). Group techniques for program planning. A 
guide to no minal oroup and Delphi . Chicago: Scott, Foresman. 

Dillman, D. A. (1978). Mail and telephone surveys . New York: Wiley-lnterscience. 

Edgar. E. (1987). Secondary programs in special education: Are many of them justifiable? Exceptional 
Children . 53(6), 555-561. ' 

Edgar, E. (1988). Markers of effectiveness at the secondary level in special education. Proceedings 
of the Research in Education of the Hand icapped Proiect Di rector's Mafttinn. Washington, DC- 
Office of Special Education Programs. 

Fardig. D. B., Algozzine, R. F., Schwartz, S. E., Hensel, J. W., & Westling, D. L (1985). Postsecondary 
vocational adjustment of rural, mildly handicapped students. Exceptional Children . 52(2). 115- 

Fowler, F. J. (1984). Survey research methods . Beverty Hills, CA: Sage Publications. 
Frey, J. H. (1983). Survey research bv telephone . Beverly Hills, CA: Sage Publications. 



24 



22 

Green, K. E. (1989). Reluctant respondents: Differences between earlv. late and nonresoonders to a 
mall survey . Paper presented at the annual meeting of the American Educational Research 
Association, San Francisco. 

Halpern, A. S., Nave, G., Close, D. W., & Nelson, D. (1986). An empirical analysis of the dimensions 
of community adjustment for adults with mental retardation in semi-independent living programs. 
Australia and New Zealand Journal of Developmental Disat)llitie8. 12(3), 147-157. 

Hasazi, S. B., Gordon, L R., & Roe, C. A. (1985). Factors associated with the employment status of 
handicapped youth exiting high school from 1978 to 1983. Exceptional Children. 51(6), 455- 
469. 

Johnson, D. R., Thuriow, M. L, Bruininks, R. H., Weathemian, R. G., & Sinclair, M. F. (1988). Design 
of secondary ^.r ansition foUow-alono follow-up system . Project funded by U.S. Department of 
Education (Grant Number H158R80022). 

Lange, C, Thuriow, M. L, & Bruininks, R. H. (1988). Practitioner's views of follow-up and cost-benefit 
informatton needed to evaluate secondan^ instructional programs for handicapped students . 
Minneapolis: University of Minnesota. Unpublished paper. 

Levin, E., Zigmond, N. & Birch, J. (1985). A follow-up study of 52 learning disabled students. Journal 
of Learning Disabilities . 18, 2-7. 

Light, R. J., & Pillemar, D. 8. (1984). Summing up: The scier^ce of reviewing research . Cambridge: 
Harvard University Press. 

Mathematica Policy Research (1982). Videotape on 'role and bias' and 'probing.' Princeton, NJ: 
Mathematica Policy Research. 

Mckensie Senter, S. J., & Houston, R. (1981). Perceptk)ns of teacher educators, futurists, and laymen 
concerning the future of teacher education. Journal of Teacher Educati on. 32(5), 35-39. 

MUhaug, D. E., Horiuchi, C. N., & Fanning, P. N. (1985). A report on the Colorado statewide follow-up 
survey of special education students. Exceptional ChiMren. 51 (5), 397-404. 

Moore, C. M. (1987). Group techniques for idea building . Beveriy Hills, CA: Sage Publications. 

Putnam, J., & Bruininks, R. H. (1986). Future directions in deinstitutionalization and education of 
children with handicaps: A Delphi investigation. Exceptional Children . 53, 58-61. 

Schalock, R. L, Wolzen, B., Ross, I., Elliot, B., Werbel, G., & Peterson, K. (1986). Postsecondary 
community placement of handicapped students. A five-year follow-up. Learning Disability 
Quarteriv. 9(4), 295-303. 

Semmel, D. S., Cosden, M. A., & Konopak, 8. (1985). A comparative study of emplc / ment outcome s 
for special education students in a cooperative wort< placement program . Paper presented at 
CEC, Anaheim. 

Schioedel, J. G. (1984). Analyzing surveys on deaf adults: lmplk:ations for survey research on persons 
with disabilities. Social Science Medicine . 19(6), 619-627. 



25 



23 



Sigelman, C. K., Schoenrock, C. J., Winer, J. L, Spanhel, C. L, Hromas, S. G., Martin, P. W., Budd, E. 
C, & Benst>erg, G. J. (1981). issues in interviewing nientaily retarded persons: An eu.piricai 
study, in R. l-i. Bruininks et ai. (Eds.), Deinstitutionalization and communitv adjustment of 
m entailv retarded peopie . (pp. 114-129). Vashington, DC: American Association on Mentai 
Deficiency. 

Sinciair, M. F., & Jofinson, D. R. (1989). Minnesota post-schooi foiiow-up system: Procedures manual . 
Minneapolis: University of Minnesota, Institute on Community Integration. 

Tfiurlow, M. L., Bruininks, R. H., & Lange, C. M. (1989). Assessing post-s c hool outcomes for students 
with moderate to severe mental retardation (Project Report Number 89-1). Minneapolis: 
University of Minnesota, Institute on Community Integration. 

Thurlow, M. L, Bruininks, R. H., Wolman, C, & Steffens, K. (1989). OccuBational and social status of 
persons with moderate, severe, and profound mentai retardation after leaving school . 
Minneapolis: University of Minnesota, Institute on Community Integration. 

Thurlow, M. L., & Larson, N. W., & Bruininks, R. H. (1989). A follow-up amUysis of students served in 
programs for emotional or behavior problems. Unpublished manuscript. 

Van Mouten, T., & Hatry, H. P. (1987). How to conduct a citizen survey . Chicago: American Planning 
Association. 

Wehman, P., Kregel, J., & Seyfarth, J. (1985). Employment outlook for young adults with mental 
retardation. Rehabilitation Counseling Bulletin . 90-99. 

White, W. J., Schumaker, J. B., Warner, M. M., Alley, G. R.. & Deshler, D. D. (1980). The current status 
of young adults identified as learning disabled durino their school career . (Research Report 
#21). Lawrence: University of Kansas, Institute for Research in Learning Disabilities. 

Williams, P. & MacDonald, A. (1986). The effect of non-response bias on the results of two-stage 
screening surveys of psychiatric disorder. Social Psvchlatn/, 21, 182-186. 

Wolman, C, Bruininks, R. H., & 'iTiurlow, M. L (in press). Dropouts and drop out programs: 
Implications for special education. Remedial and Special Education . 

Worthen, B. R., & Sanders, J. R, (1987). Educational evaluation: Altemative approaches and practical 
guidelines . New York: Longman. 

Wyngaarden, M. (1981). Interviewing mentally retarded persons: Issues and strategies. In R. H. 
Bruininks et ai. (Eds.). Deinstitutionalization and communitv adjustment of mentailv retarded 
people (pp. 107-113). Washington, DC: American Association on Mental Deficiency. 

Zigmond, N., & Thornton, H. (1985). Follow-up of postsecondary age learning disabled graduates and 
dropouts. Learning Disabilities Research . 1(1), 50-55. 



26 



TaMt 1 



Oriflnal 



Idintlfltd 
Subjtctt 



Bnifnlnkt tt. 
tt.« 1968 



Aetval lU 



Rtfpmt 



Rdspondtnt t 
vt Hofi'Rtt 



CeotKt 
TtdmiquH 



niaptad 



Control group 
or comporiton dott 



Typt of 
rtandicip 



Modi of 

OtU Cottoetlon 



66X 



1*7 ytert 



to with LO^IHR, 



MH qutttlonniiro 
(•tudonts rotpondtd) 



Cdstr, 1907 



rordii ot. 
ol., 1985 



SIX iridMUt, 

21X dropouts 



6 imtht 



SB utth L0/IO,MM, 
Sov hondM ttnoory 
Impolminto 

St with CNH, SIO, CO 



Tolophont Intorvlttt 
(Poronto rttpondod) 



Poco-te*fooo Intorvltw 

(foratr otudtnt or fwiUy adu(t) 



Notoil ot. 
ot., 1985 



Itvin ot. 
ol., 1985 



HUhwig ot. 
o(., 1985 



ThurloWf 
•rulnlnlit, 
Langt, 1988 



Thurlow* 
Irulnlnkt, 

Stofftnt 

1989 



ThurloMf 

Lortonf 

irulnlnko 

1989 



WflURon ot* 
ol., 1985 



Uhltt ot. 
•U, 1980 



ZIgnond & 
Thornton^ 
198S 



Scholock ot. 
1986 



ERJC 



6SX 



65.3X 



2 sroupo: 

1) 87X 

2) 90.71 

3) 90.5% 



86.4X 



5S.5X (nMd) X 
20. 5X (tovoro) 



nx 



S9X 



57X 



8U 



1-5 yooro 



4 yoort 



4-6 yt^rt 

(opprox.) 



2 groups: 

1) 7-10 yrt 

2) 3-5 yrt 

3) 1-2 yrt 



1-5 ytoro 



1-8 ytort 



1-6 ytort 



5 Montho to 
5 ytort 



6 ytort 



Up to 5 yrt 
<yrly eollKtlon 
of dtto) 



Portiol 



PortUl 



(group ulth 
nMd horviicopo) 



(Modtrott v« ttvtro) 



St Mith «Ud hond< 
In rttourco rooit 
I M in tptclot 
clrjttt 



Sf M/(tom1ng 
d\tobit1tiot 



St uf*:h m, Porctpt/ 
nic.f ElOy Phyt. 



St M/modtroto 

& ttvtro rotordatlon 



St M/«odoroto 

i ttvtro rotordttlon 



St H/»ltd or 
ttvtro OMOtlonil 
probltM 



St ulth Modtrttt, 
ttvtrtf profouid NK 



St u/(tomlno 
dItobHUItt 



St u/lttrning 
dltobllUItt 



St w/iKOdtrttt 

to otvtrt htndleopt 



Ttltphont fntorvitu 

(ttudtntt or portntt or othtrt) 



Totting and foct-to-foct 
Inttrvlow (ttudtntt rttpondtd) 



roct-to-ftet Intorvlttt 
(Studtnts rttpondtd) 



OuHtlonntIro trid fteo- 
to-foco Intofvitu (group 
hot* ttoff I portntt 
rttpondtd) 



Outttlonntirt tnd fact* 
to-ftct Inttrvftw (grotjp 
hem tttff & ptrtntt 
rttpondtd) 



Mtll qutttlonntirt m 
ttltphont Inttrvltw 



Fact-to-fMO IntorvitM 
(Ptrtntt rttpondtd) 

NaU turvtyt 
(Studtntt rttpondtd) 



Pacfto-foco Intorvlttt 
(ttudtntt rttpondtd) 



Faca-to-faca Intarvltu 
(fonatr ttudtnt or fMlly 
tr) 




In ttvtrti caati nmittfa arw approxlMta aatlnotort of tht oiapaad tiM (data wart not oxpHeltly rtporttd). 



Flgur« Caption 
Figure 1. Flow Chart of Survey Research Process 



29 



Planning Decisions 
and Definitions 

Procedures and 
Sample Selection 



Survey Objectives 
(e.g., Info needed) 



Mode of Data Collection 
(telephone /mall/face-to-face) 
1 



Questionnaire 
Design 



Sampling 
Process 



Survey 



Analysis and 
Reporting 



Subjects not found 



I 



Follow-up contact 

t 



Non-Respondents 



ERIC 



30 



I 



Questionnaire 
Const ruction 

~~r~ 



Selection of a Sample 

1 



Subsample Selection; 
Pretest or Pilot test 



1 



Alterations necessary 
on Instrument 



I 



Validity and reli- 
ability of Instrument 



i 



Non-Respondents 
(Refusals) 



Survey Administration 



j_Ana 



I 



Analysis Of Data Collected 



L Report or DutaCv-Jl lection 



Subjects found 



Follow-up contact 



Comparisons between 
Non-respondents and 
Respondents 



Sample Design 



I 



Respondents 

— r~ 



31 



